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We study chaotic size dependence of the low temperature 
correlations in the SK spin glass. We prove that as tem- 
perature scales to zero with volume, for any typical coupling 
realization, the correlations cycle through every spin config- 
uration in every fixed observation window. This cannot hap- 
pen in short-ranged models as there it would mean that every 
spin configuration is an infinite-volume ground state. Its oc- 
currence in the SK model means that the commonly used 
'modified clustering' notion of states sheds little light on the 
RSB solution of SK, and conversely, the RSB solution sheds 
little light on the thermodynamic structure of EA models. 



Introduction. The Sherrington-Kirkpatrick (SK) spin 
glass [1] is believed to obey the Parisi replica sym- 
metry breaking (RSB) solution [2], traditionally inter- 
preted in terms of infinitely many 'pure states' and their 
overlaps [3-6]. Because pure states — and their zero- 
temperature counterparts, ground states — are infinite- 
volume objects, there has been ambiguity in the interpre- 
tation of these results and in their relevance for realistic 
models such as Edwards- Anderson (EA) [7]. In [8] and 
succeeding papers, we showed that contradictions arise 
when results for the SK spin glass are applied to EA. In 
this paper, we give a striking example of the disconnect 
between short- and infinite-ranged models which shows 
the dangers in transporting notions in either direction. 

We will consider the SK Ising spin glass for a system 
of N spins, in zero external field. Its Hamiltonian is: 



T~tj,N 
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where erfc = ±1 and the couplings Jij are independent, 
identically distributed random variables chosen from a 
Gaussian distribution with zero mean and variance one. 
The N^ 1 / 2 rescaling in (1) ensures a sensible thermody- 
namic limit for free energy per spin and related quan- 
tities. For a fixed coupling realization, denoted by J , 
Eq. (1) leads to the finite- Af Gibbs distribution, at in- 
verse temperature /?, on spin configurations a: 



Pn(ct) = Zj^exp 
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(2) 



Here Zn is the usual A-spin partition function, and the 
dependence of p and Z on (3 and J has been suppressed. 

Previous rigorous results support certain aspects of 
the SK high-temperature solution and the Parisi low- 
temperature one. Early results [12,13] mostly (though 
not exclusively) concerned the high-temperature phase. 
Pastur and Shcherbina [14] proved non-self-averaging of 
overlaps (which already implies more than a single pair 
of states), though for a slightly modified Hamiltonian. 
They also proved self-averaging of the free energy den- 
sity (see also [15,16]). At around the same time the 
authors proved that non-self-averaging implied chaotic 
size dependence of the overlap function [17]. More re- 
cent work [18,19] has focused on proving existence of the 
thermodynamic limit of the free energy density for almost 
every coupling realization. For more results, see [19]. 

Detection of Multiple States. In short-ranged statisti- 
cal mechanical models, including the EA spin glass, pure 
states (and their zero-temperature counterparts, ground 
states) are well-defined objects. Both finite- and infinite- 
volume 'states' are specified by all 1,2,.. .-spin correla- 
tion functions at fixed temperature. A thermodynamic 
state is an infinite- volume state satisfying the DLR equa- 
tions [20-23], or, equivalently, is one which is a limit of 
finite- volume Gibbs states [20-26]. Pure states are then 
defined either in terms of clustering properties or, equiv- 
alently, by a "non- mixture" requirement. 

Although pure states have been widely used in inter- 
preting the meaning of the RSB solution of the SK model, 
there is a difficulty: pure states are defined for a fixed re- 
alization of all of the couplings, but in the SK model the 
physical couplings Jij/y/N scale to zero as N — > oo. To 
address this problem, pure states have been defined in 
the SK model using an analogy to the 'clustering' prop- 
erty of pure states in short-ranged models (although the 
non-mixture definition has also been used [3]). A puta- 
tive pure state a in the SK model has been defined as 
one satisfying the modified clustering property [6,27]: 







as N — > oo 



(3) 



for any fixed pair 

It is useful to note that some of these difficulties are 
absent in the Curie- Weiss model of the uniform ferromag- 
net, even though physical couplings scale to zero there 
also. But in the ferromagnet, the couplings "reinforce" 
each other, being nonrandom, so it still makes sense to 
talk about positive and negative magnetization states in 
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the TV — > oo limit. This difference between homogeneous 
and disordered systems has important consequences. 

We will consider the effects of adding a spin to an TV- 
spin system, which simultaneously requires the introduc- 
tion of TV new couplings (the 'cavity method' [6]). Rather 
than attempting to construct individual pure states di- 
rectly, we propose a procedure for detecting the presence 
of multiple pure states. Consider the Curie- Weiss ferro- 
magnet, where addition of a single spin will not substan- 
tially alter a given correlation function. In an operational 
sense, one can in principle keep a record, at fixed 0, of 
the values of a finite set of even correlation functions as 
TV grows. If these values approach a nonzero limit, as in 
the mean-field ferromagnet, one can with some justifica- 
tion describe the low-temperature phase as consisting of 
a single pair of 'pure states', with each finite-spin Gibbs 
state pn being an equal mixture of the two. If, how- 
ever, the correlation functions persist in changing their 
values as TV grows, then one can infer that there must 
exist multiple pairs of pure states. That is, the existence 
of multiple states manifests itself through the presence of 
what we have called chaotic size dependence (CSD) [17]. 

This perspective makes clear that many states should 
exist in the SK model. As TV — > oo, any specified correla- 
tion function cannot depend on any finite set of couplings, 
whose magnitudes all scale to zero. Given that the new 
couplings accompanying each additional spin are chosen 
independently of the previous set, it naturally follows that 
below T c any specified correlation function should not 
settle down to a limit. 

Chaotic Size Dependence. We can further refine this 
approach to quantify the number of states for fixed J . 
We first make precise the notion of CSD. 

Definition. For fixed J and a sequence of TV's chosen 
independently of J , chaotic size dependence is present if 
there is no single limit for some fixed correlation function 
(computed in the usual way using (2)) as TV — > oo. 

Spin-flip symmetry ensures that all odd-spin correla- 
tion functions vanish. We will therefore focus on even- 
spin correlation functions. Our first theorem proves 
chaotic size dependence in the SK model below some 
nonzero temperature (which presumably corresponds to 
the transition temperature, and so we call it T c ). Be- 
fore stating the theorem, we first prove the intuitive re- 
sult that, if any two-point correlation function {uiUj), at 
some fixed (3 < oo, has a limiting value as TV — > oo, its 
value cannot depend on any finite set of couplings. 

To see this, we note that, for any fixed J, 

{o-iO- ) N fi + (o-iajakai) N fitanh(P J k i/VN) 

\0~iO~j)N = -j= . 

1 + ((Tfc(T/)7v,otanh(/3J fe ;/vTV) 

(4) 

where (-)jv,o denotes a thermal average taken with the 
coupling Jki set to zero. (When (ij) = (kl) this for- 



mula reduces to Eq. (4.3) in [12].) In the limit where 
(3Jki/VN — > 0, this becomes 

(o-iO-j) N - (o-i(Tj)Nfl = 0(pJki/VN) (5) 

This goes to zero for any finite (3 as TV — > oo, proving 
the result, which can be extended to zero temperature 
by taking (3 — > oo slower than VTV- (This point will be 
discussed further below.) 

Theorem 1. In the Sherrington-Kirkpatrick Ising 
spin glass, there exists a temperature T c > below 
which all two-point spin correlations asymptotically dis- 
play chaotic size dependence, with probability one in the 
coupling realizations J . 

Proof. We consider nonzero temperature; the zero- 
temperature case is handled by letting (3 — > oo slower 
than y/N, as mentioned above. Suppose that, as TV — > oo, 
a limit exists for some even-spin correlation function, say 
{o-\CF2), with strictly positive probability in J] let ci2(/3) 
be this limiting value. Because c\2{(3) does not depend on 
any finite set of couplings, it must be the same for almost 
every J by the Kolmogorov zero-one law (see, for exam- 
ple, [28]). But by doing a gauge transformation in which 
<72 and all the couplings connected to it are inverted, one 
arrives at a limit — Ci 2 (/3) for the corresponding J' . This 
violates the constancy of the limit with respect to changes 
in J, unless ci 2 (/3) = 0. The absence of chaotic size de- 
pendence for any even-spin correlation function therefore 
requires it to vanish as TV — > oo. 

We now show that every two-spin correlation function 
exhibits chaotic size dependence below some temperature 
T c . By the permutation symmetry of the coupling distri- 
bution, if any m-spin function has a limit with strictly 
positive probability in J, then all m-spin functions have 
limits for a.e. J . At nonzero temperature, there thus 
remain two possibilities: either all two-point correlation 
functions exhibit CSD, or they all have a zero limit. 

But the latter violates a simple bound when j3 is suffi- 
ciently large. A straightforward integration by parts for 
each Gaussian coupling variable gives 

e N = -^(l-l/N)(l-J^}%) , (6) 

where [•] indicates an average over all coupling realiza- 
tions, and eAr is the averaged energy per spin in the 
TV-spin system. Because is bounded fr om belo w, 
there must be a temperature T c below which (o~ia2}% is 
bounded away from zero for any TV [12]. Then ( 01 02) at 
cannot converge to as TV — > oo below T c for a.e. J, 
proving the theorem, o 

The proof of Theorem 1 should be extendable to higher 
even-spin correlation functions, though this isn't neces- 
sary for what follows. We note that if there is a unique 
state, such as the paramagnetic state above T c , then there 
cannot be chaotic size dependence. The proof of Theo- 
rem 1 then requires all two-point correlation functions to 
converge to zero, consistent with (3). 
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Ground States in the SK Model. The presence of CSD 
for all two-point correlations below T c already implies 
the existence of more than a single pair of spin-reversed 
states. The natural followup is to ask, how many? 

Recall that a ground state is a pure state at zero 
temperature. Using the definition of 'pure state' in the 
SK model given in [6,27], based on the clustering prop- 
erty Eq. (3), we note that any pure state must be re- 
garded as a limit of finite-volume Gibbs states given 
by Eq. (2); otherwise Eq. (3) makes no sense. Because 
the remainder of the paper focuses on ground states, we 
confine our attention to them here. In a fixed volume 
with specified boundary conditions, such as free, a finite- 
volume ground state pair is of course simply the spin- 
reversed pair of spin configurations of lowest energy. So, 
to be consistent with Eq. (3), a 'ground state' in the 
SK model should be any convergent sequence of finite- 
volume ground states; i.e., where every finite set of spins 
has a limiting configuration. We note that this definition 
is exactly the same as the standard definition of a ground 
state in short-ranged models [20-26] . 

What happens when chaotic size dependence is 
present? In that case, there must exist two or more sub- 
sequence limits (along different increasing sequences of 
volumes, all presumably ^-dependent), of finite- volume 
ground states. The number of ground states is then at 
least as large as the number of distinct limits (it may 
be larger because of the flexibility in choice of bound- 
ary conditions). This construction, used extensively for 
short-ranged models like EA, can be applied equally well 
to the SK model, and allows comparison between the two. 

In the proof of Theorem 1, we studied the zero- 
temperature limit by taking both (3 and N simultane- 
ously to infinity, with (3 diverging more slowly than ^/N. 
While we did this to simplify the proof, it can easily be 
shown for short-ranged models that this method leads 
to limiting ground states without having to first take 
(3 — > oo for finite N, and then take TV — > oo. We 
note that if the energy gap between the ground state 
and the low-lying excited states, of the type considered 
in [29] , remains of order one (that is, does not approach 
zero) as N — > oo, as is widely expected [6], then it can 
be shown that the two approaches to constructing zero- 
temperature SK ground states lead to the same outcome. 
We therefore will not concern ourselves further with this 
distinction, when using the term ground state. 

We now prove that the number of ground states is in 
fact infinite: 

Theorem 2. The SK spin glass has infinitely many 
distinct subsequence limits for the collection of all spin 
correlations (as (3 — > oo, (3/^/N —* 0) for a.e. J . 

Proof. Eq. (6) shows that as (3, N — > oo (with 
(3/V~N — > 0), {o-io-2) 2 N — ► 1. We can then choose 
Ni « N 2 « ■ ■ ■ (in a J- independent way) so that ev- 
ery (o-iO-j) 2 Ne — > 1 and hence all limits have {<&%<?]) = ±1. 



The essential idea we will use is that, if there is only 
a finite number k of ground state pairs, then there must 
be a positive fraction of 2-point correlations (piOj) that 
are the same in all k pairs. By interchanging an average 
over (i,j)'s with one over J's, it would then follow that 
for some fixed (io, jo)) the function (cj crj ) would be the 
same for all ground states in a positive fraction of jFs, 
yielding a contradiction with Theorem 1. 

+ + + + + + + + + cc 
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+ x- x + x- x+ y 

FIG. 1. Spins 1 through 9 in ground states a, 9, and 7 
described in the text. An x indicates that it doesn't matter 
whether the spin is + or — . 

By a gauge transformation, we can always choose a 
ground state — call it a — with all spins +1. Then the 
maximal disagreement that ground state 9 can have with 
a is in half of the 2-point correlations (cf. Fig. 1). So a 
and 9 (and their global flips) agree on (say) the (aia i+2 ) 
correlations. If a third ground state 7 is introduced so 
that it maximally disagrees with both a and 9, all three 
will still agree on (say) the (crjOi+4) correlations with i 
odd. Continuing, it is easy to see that if there are k 
ground state pairs, the (o~iO- i+2 k-i) , . . . correlations will 
all agree for i odd. o 

Ground State Structure of the SK Model. We next ask 
whether there exists a countable or uncountable infinity 
of ground states. In the following theorem (which holds 
for a.e. fixed J"), we prove not only that there is an un- 
countable infinity, but in fact something much stronger. 

Theorem 3. In the Sherrington-Kirkpatrick Ising 
spin glass, as (3, N — > 00 (with (3/^/N — ► 0), the signs 
of {o-iO-j) for 1 < i, j < K cycle through the signs of all 
2 K spin configurations infinitely often for every K . 

Remark. This is equivalent to the statement that every 
infinite- volume spin configuration is a ground state. 

Proof. We again focus on volumes N\ « N 2 « ■ ■ ■ 
as in the proof of Theorem 2. For two sizes M, N (with 
M « N), let J M denote all the couplings in the M-spin 
system and J N - M denote all the remaining ones in the 
A-spin system. As M — Mi and N = Nf — ► 00, it follows 
from (5) that the limiting ground states are unchanged 
by setting J M = providing CmP/Vn -» (where C M 
is a constant times the sum of the coupling magnitudes 
in J M ). Furthermore, by a simple gauge transformation 
argument, when J M is set to zero, the resulting signs of 
(ctiCTj) are equally likely (as J N > M varies) to take on the 
signs of any of the 2 K spin configurations in any iGspin 
system with K < M. 

We next choose a sequence of sizes N[ « N 2 « ... 
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from the N^s and generate the full J sequentially using 
J N '\J N '^ N '\. . . so that C N > e i /y/Nl^ 0. This ensures, 
with probability one, that for any fixed K, the correlation 
function values in the A^-state, as £ — > oo, run through all 
possible sign configurations infinitely many times. Since 
this is true for every choice of K, we conclude that, for 
a typical fixed J , the set of all ground states includes 
every infinite volume spin configuration, o 

Discussion. In this paper we have proved three sepa- 
rate theorems about the low-temperature phase of the SK 
model. The first two together show that, given the usual 
notion of ground states, there must be infinitely many of 
them. There is also chaotic size dependence of finite- TV 
Gibbs states, for all temperatures below T c . However, 
proving infinitely many states is a stronger result than 
simply showing the existence of chaotic size dependence, 
since the latter implies only that there exists more than 
a single spin-reversed pair of states. 

The idea underlying the proof makes transparent why 
the SK model displays many ground states. It follows 
from two facts: the independence of the couplings and 
their scaling to zero as N — > oo. The latter condition, 
being absent for the EA model, suggests that the presence 
of many states in the SK model provides little informa- 
tion on what should be expected in finite dimensions. 

Our third result is that, as N increases, any fixed fi- 
nite set of correlation functions cycles through all of its 
possible spin configurations infinitely many times. This 
striking phenomenon cannot happen in short-ranged spin 
glasses in any dimension: it would be equivalent to every 
infinite-volume spin configuration being a ground state 
for fixed coupling realization. This is a major qualitative 
distinction between SK and EA models. 

It goes further. It demonstrates that the usual, well- 
defined (for short-ranged models) notions of pure and 
ground states [20-26], should not be carried over to the 
SK model. Put another way, our result implies that any 
local notion of state, e.g. using correlation functions as 
in Eq. (3), leads to absurd conclusions for the SK model. 

The standard interpetation [3-6] of the RSB solution, 
in terms of infinitely many pure states and their overlaps, 
even using definitions modified for the SK model as in 
Eq. (3), should therefore perhaps be revisited. Our result 
does not address the idea that there is some more global 
notion of states relevant to the SK model, and through 
which the RSB solution can be correctly interpreted. If 
so, we expect it is unique to the SK (or related) model(s), 
since the usual notion of pure and ground states already 
suffices for other (short- or long-ranged) systems. 
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